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(54) Methods and apparatus for operating on non-text messages 



(57) Methods and apparatts for operating on a non- 
text (voice or fax) message include for each of a number 
of voice messages, searching each voice message for 
signal samples having one of a plurality of sets of pre- 
defined characteristics (such as any seven or ten digit 
number which is then assumed to be a tel^hone 
number) as didosed. For each signal sample found to 
have one of the sets of pre-defined characteristics, the 
found signal sample is associated with an equivalent 



text string and this text string is stored in an envelope for 
the message. Based on a user irput, the messages 
may be searched for a given text string and on finding a 
message envelope containing the given text string, such 
message may be operated upon. 

Other modifications in accordance with the scope of 
the invention will be apparent to those skilled in the art. 



-50 



52 
S 

ENVELOPE 



-66 



- FIELD - 



- FIELD - 



S4 



CNi 
< 
CO 

o> 

LO 



USG 
TYPE 


BASED* SAMPLE 
>EQUiV.' POINTER 
■ 1 . 1 . 


™niTEXT- . SIGNAL 
^'^^'bASEd' SAMPLE 
*EQUtV.' POINTER 

1 r 




BASED 'sample 
" 'eQUIV.' POINTER 


NON-TEXT 
MESSAGE 



60 



62 



64 



FIG. 3 



LU 



Primed by Xerox (UK) Business Services 
2.16.7 (HRS)/3.6 



1 



EP 1 001 593 A2 



2 



Description 

[0001] The present invention relates to methods 
and apparatus for operating on messages, and more 
particularly for operating on non-text messages, such 
as voice and facsimile messages, including, for exam- 
ple, searching such messages. 
[0002] Modern communications technology has 
produced voice mail, faxes, e-mail, video conferencing 
and many other ways to send messages. 
[0003] The growth in voice mail systems has been 
explosive. In 1996, telephone company revenues gen- 
erated by providing Voice Mail service exceeded one 
billion dollars. While business users typically buy voice 
mail systems, residential customers buy this service 
from telephone companies. The residential market 
accounts for 82% of telephone company voice mail sub- 
scribers and 69% of revenues generated- Thus, voice 
mail and faxes are fully part of the daily compnunications 
fabric. 

[0004] In the last twenty years the use of facsimile 
messaging (fax) has also exploded. The cost of fax 
machines has decreased steadily, and with the advent 
of computer telephony (CT), faxes can be received and 
sent via local area networks (LANs) directly to comput- 
ers on the user's desktop, eliminating the need to even 
walk down the hall to the fax machine. 
[0005] Known systems will collect all digital commu- 
nications, display the time of receipt, the source of the 
message, and indicate whether it is voice mail, a fax, or 
e-mail. 

[0006] With known systems, a user with a tele- 
phone system and a computer can quickly become 
inundated with information. As such, it is important to be 
able to separate important messages, or messages 
which contain key information, from routine messages 
or electronic junk mail. With known sysliems this is diffi- 
cult. In addition, finding key elements of messages can 
be time consuming and difficult, if not impossible. 
Known systems provide functions for finding, filtering, 
filing and re-directlng textual messages (e.g., e-mail) 
but do not do so for voice or facsimile messages. 
[0007] It is an olDject of the invention to overcome 
disadvantages of the prior art and associated with the 
known methods. 

[0008] The above object is met by the combination 
of features of the main claims, the sub-claims disclose 
further advantageous embodiments of the invention. 
[0009] The present invention solves these probi ems 
by providing a way for searching for. or through, non-text 
messages to find certain information, or to determine if 
certain information is included therein, and/or for per- 
forming other operations thereon. In conjunction with 
the present invention, a search is undertaken for one or 
more signal samples having pre-defined characteristics 
by comparing one or more signal samples of non-text 
messages with these pre-defined characteristics. For 
exanple, the pre-defined characteristics may comprise 



one or more templates for voice sarrples which make 
up a specific word (e.g., "urgent"). In that case, these 
voice templates may be compared with signal samples 
of a voice message in a search for signal sanples which 

5 match these voice templates. In addition, and in accord- 
ance with the present invention, a non-text message, 
having pre-defined characteristics may be operated 
upon to provide a desired result (e.g., forwarded). 
[0010] Therefore, in accordance with the present 

10 invention, there is provided a method for operating on a 
non-text message including searching the message for 
one or more signal samples having pre-defined charac- 
teristics by comparing one or more signal samples witii 
the pre-defined characteristics. 

15 [0011] In accordance with a further aspect of the 
invention, there is provided a method for operating on a 
non-text message, including searching the message for 
one or more signal samples having pre-defined charac- 
teristics and upon finding one or more signal samples 

20 having the pre-defined characteristics, operating on the 
message. 

[0012] In accordance with another aspect of the 
invention, tiiere is provided an apparatijs for operating 
on a non-text message, including a non-text search 
25 engine for searching the message for one or more sig- 
nal samples having predefined characteristics by com- 
paring one or more signal samples witii the predefined 
characteristics. 

[0013] In accordance with anotiier aspect of the 
30 invention, there is provided apparatus for operating on a 
non-text message, including: a unit for searching the 
message for one or more signal samples having pre- 
defined characteristics; and a unit for. upon finding one 
or more signal samples having the pre-defined charac- 
35 teristics. operating on the message. 

[0014] In the figures, which illustrate example 
embodiments of the invention, 

figure 1 is a block diagram of an apparatus in 
40 accordance with this invention connected to a net- 
work, 

figure 2 is a block diagram of a processor which is 
part of the apparatus of figure 1 , 

45 

figure 3 is a schematic diagram of a message sti-uc- 
ture created by the apparatus of figure 1, and 

figures 4a, 4b. and 4c are flow diagrams of methods 
50 in accordance with the invention. 

[0015] The following description Is of a preferred 
emtxxjiment by way of example only and without limita- 
tion to the combination of features necessary for carry- 
55 ing the invention into effect. 

[0016] Rgure 1 shows an apparatus 10 in accord- 
ance with the invention which can search for information 
in one or more non-text messages and perform other 
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operations thereon. Apparatus 10 is connected via Its 
processor 12 for two-way communication witii a digital 
network 14. Network 14 has non-text based message 
traffic and may also have text-based message traffic. 
The network 14 may comprise any communications net- 
work, including, for example, an internet, intranet, or tel- 
ephone network 

[0017] The non-text messages may be voice mes- 
sages, video messages with a voice component, or fac- 
simile messages (which, as will be understood by those 
skilled in the art, are graphics messages which typically 
include text in graphical fomn). As will be appreciated by 
these skilled in the art. the messages with a voice com- 
ponent comprise quantised analog voice signals. The 
text-based messages are digital messages according to 
the text standard of the network, which is typically the 
ASCII standard such that the text-based messages 
comprise ASCII diaracters. 

[0018] The processor 12 is also connected for two- 
way communication with a user interface 20 and with a 
memory 26. Memory 26 may comprise any appropriate 
kind of volatile and/or non-volatile memory 
[0019] As seen in figure 2, the processor 12 
includes an enveloped message creator 28 which 
receives Inputs from the network and outputs to a non- 
text search engine 30 and a menrrary interface 36. The 
non-text search engine 30 is connected for two-ray 
communication with the memory interface 36. The 
memory interface interfaces with the memory 26 (figure 
1) and is also connected for two-way communication 
with an interpreter 37 and a text-based message opera- 
tions engine 38. The Interpreter 37 interfaces with the 
user interface. The text-based message operations 
engine 38 also interfaces with the user interface and is 
connected for two-way communication with a text-based 
envelope search engine 40. 

[0020] The memory 26 (f^ure 1) stores an enve- 
lope shell. Briefly referencing figure 3. the format of this 
shell (which will be detailed hereinafter) is illustrated at 
52. Memory 26 also stores sets of pre-defined charac- 
teristics. Each set of pre-defined characteristics com- 
prises voice tennplates or facsimile graphics templates 
along with an arrangement for the templates. Text- 
based equivalents are associated with each template 
(for example, the text-based equivalent associated with 
a template may be a letter, a collection of letters, a 
number, or a collection of numbers). Thus, where a set 
of pre-defined characteristics comprises voice tem- 
plates, an equivalent text-based letter, collection of let- 
ters, words, number, or numbers to which such voice 
tennplates map is stored in association therewith. Alter- 
natively, where the set of pre-defined characteristics 
comprises facsimile graphics templates, equivalent text- 
based words, numbers, etc. to which the graphics tem- 
plates map are stored therewith. 
[0021 ] Figure 4a provides a flow chart of a method 
in accordance with this invention for handling new mes- 
sages: the operation of this method may be carried out 



by processor 12 in the system of figures 1 and 2. In con- 
junction with the invention, multi-media messages may 
be received by the enveloped message creator 28 of 
processor 12 (S1 10) from network 14. Typically, a 

5 header for these messages indicates their type - i.e., 
voice, fax, e-mail. (In this regard, it will be appreciated 
that a message may be of multiple types with a multi- 
part header to indicate each type.) In other instances, 
the type nray be implicit based on the source (e.g., mes- 

10 sages arriving from a fax application will be fax mes- 
sages). In this regard, a simple look-up table may be 
employed to associate message sources with default 
types. The message type determines whether the mes- 
sage is natively text-based or natively non-text based 

15 (or partly natively text and partly natively non-text). 

[0022] If a new message is natively text-based 
(S1 11), the enveloped message creator 28 associates 
an envelope shell with the message which merely indi- 
cates in message type area 60 (figure 3) of the shell 52 

20 (figure 3) it has a text-based native form (S1 12). Then, 
the processor passes the message directly to memory 
26 for storage (S1 1 4) as well as updating a message log 
and prompting the user that a new message has arrived 
(S1 16) in accordance with a manner known to persons 

25 skilled in the art. 

[0023] If the message is a natively non-text mes- 
sage (or has a non-text conrponent) (S1 11), the envel- 
oped message creator associates an envelope shell 
with the message, and indicates in area 60 (f igure 3) the 

30 message contains voice or facsimile graphics. The mes- 
sage creator then passes the enveloped message to 
non-text search engine 30 (S1 18). The non-text search 
engine 30 accesses a set of pre-defined characteristics 
found in memory 26. If the incoming message is a voice 

35 message, the accessed set of pre-defined characteris- 
tics comprises voice templates; if the incoming mes- 
sage is a facsinrtile message, the accessed set of pre- 
defined characteristics comprises facsimile templates 
(Si 20). For example, if the incoming message is a voice 

40 message, the set of pre-defin^ characteristics may 
comprise voice tenplates for the digits 0 to 9. arranged 
so that all digit strings of seven and ten digits in length 
(i.e., a phone number) match the set. The search 
engine then searches through the message for one or 

45 more (sequential) voice samples matching one of the 
digit templates. If a match is found, the engine looks to 
tiie next sample(s). If the next sample(s) also match a 
digit template, the search looks to the following samples 
and so on until either sequential voice samples are 

so found to match seven or ten digit templates or this 
nunrtoer of matches is not found, in which case search- 
ing continues for the next place in the message to have 
one or more voice samples matching one of the digit 
templates. By way of a further example, the incoming 

55 message may be a fax message, the set of pre-defined 
characteristics may comprise facsimile templates 
aranged to make up the word "urgent" and each facsim- 
ile tenplate may comprise one letter. The search engine 
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then searches through the fax message for one or more 
(sequential) fax samples matching the facsimile tem- 
plate for the letter "u". if this is found, the engine looks to 
the next one or more samples for a facsimile sample 
matching the letter "r*', and so on. Techniques for 
speech and facsimile graphics recognition are well 
known in the art. 

[0024] If the new message is found to contain one 
or more signal samples falling within a set of pre- 
defined characteristics (S122), then the text-based 
equivalent of the corresponding template{s) is added to 
slot 62 (figure 3) of a field 56 (figure 3) in the envelope 
of the message (S123). In addition, lor found signal 
sample(s), one or more signal sample pointers are 
stored in a slot 64 (figure 3) In the field which points to 
the location in the non-text message of the found signal 
samples (SI 24). 

[0025] If the new message does not contain one or 
more signal samples falling within a given set of pre- 
defined characteristics, then the slots for the text based 
equivalent 62 and signal sample pointer 64 of the field 
56 for the relevant search are set to null. This process is 
repeated for each of the sets of pre<lef ined characteris- 
tics In memory (Si 25). Thereafter, the non-text search 
engine 30 passes the enveloped message to the mem- 
ory interface 36 for storage in memory 26 (SI 26) and 
the message log is updated and the user is prompted 
(S116). 

[0026] Sets of pre-determined characteristics may 
be accessed sequentially from the memory 26. The 
results of sequential searches following from sequen- 
tially accessed sets of pre-defined characteristics may 
be stored in sequential fields of the envelope so that 
each field ID 58 is an ordinal representing a search 
number. Alternatively, each field ID may be populated 
by the non-text search engine with a description of the 
search and a pointer to the memory area in which the 
set of pre-defined characteristics is found. 
[0027] The sets of pre-defined characteristics are 
handled as standing search requests which are applied 
to each new message which is received. When a new 
set of pre-defined characteristics is added, optionally, a 
search of all existing messages may be undertaken 
based on the new set. 

[0028] A new set of pre-defined characteristics may 
be specified by a user as follows. Referencing figure 4b 
along with figures 1 and 2, a user may enter information 
in order to specify a set of characteristics through user 
interface 20 -which may comprise a keyl>oard, mouse, 
microphone, or other input device along with a display 
and a speaker {S100). Interpreter 37 interprets the 
information input by the user to facilitate the creation of 
a set of pre-defined characteristics (8102). For exam- 
ple, the interpreter 37 may present a graphical user 
interface (GUI) to the user. The user could then use the 
GUI to indicate, for exanrple, that a specific word (e.g., 
"urgent! is to form the basis of a set of pre-defined 
characterics whereupon the GUI would allow entry of 



the word. The user could also specify whether the set is 
to apply to voice messages, facsimile message, or both 
voice and facsimile messages. The interpreter then 
obtains the necessary templates and an-anges these 

5 appropriately to create the new set of pre-defined char- 
acteristics (8104). In the case of an entered word to be 
applied to both voice and facsimile messages, the 
resulting set of characteristics constitutes voice tem- 
plates and facsimile templates arranged to make the 

10 specific word. Preferably, the search interpreter 37 
obtains the necessary tenrplates from memory 26 which 
may store templates for voice and facsimile graphics. 
The search interpreter also associates each template 
with a text-based equivalent (S105). Memory 26 also 

15 preferably stores the text-based equivalent to which 
each template maps to facilifate an association of any 
given set of templates with text-based equivalents. The 
new set of characteristics is then stored in memory 26 
along with an assodation to the text-based equivalents 

20 (S1 06), and a field is added to the envelope shell for this 
set which has a field ID pointing to the set in memory 
(S108). 

[0029] Figure 4c provides a flow chart of a method 
in accordance with this inverttion for the handling of user 

25 message operations requests. Referencing figure 4c. 
along with figures 1 and 2. through user interface 20, a 
user may input a message operation request to proces- 
sor 12 (Si 30). For example, the user may ask that any 
telephone number which might be part of a specified 

30 message be dialled or placed in a directory (i.e., stored 
separately from the message), that any URL found in a 
message from a certain sender be added to a bookmark 
file or sent to a twowser program to allow access to an 
internet resource (e.g., web page), or that all messages 

35 containing certain keywords (e.g., messages containing 
the words "low priority") be deleted or played back. The 
message operation request is input to the text-teased 
message operations engine 38. If the request involves a 
search for a text-based string (e.g., the word "urgent") 

40 (SI 32), the search parameters (e.g.. message number 
of a specified message or an indication all messages 
are to be searched, along with an Indication of the text- 
tjased string or strings which will satisfy the search) are 
passed to the text-based envelope search engine 40. 

45 The search engine searches the envelopes of all or 
specified messages for any text-based strings falling 
within the search parameters (S133). On finding such a 
string (or strings) (S134), the engine Identifies the mes- 
sage number and string(s) to the text-based operations 

so engine 38. The operations engine then operates on the 
message in accordance with the user's request (S136). 
This could involve, for example, automatically dialling a 
telephone number found in the envelope for a specified 
message or deleting, filing, or playing specified mes- 

55 sages or messages from a specified sender. Also, tiie 
message, or a copy thereof, could be fonvarded. In 
addition, where tiie message has a voice component, 
the system may be configured so that the operations 
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engine 38 utilises the signal sannple pointers 64 (figure 
3) in the envelope field for a found string to call up the 
voice signal sarnple(s) represented by the string and 
play this on a speaker which is part of tfie user interface 
(S138. S140). Similarly, a fax message may have a 
sample called up and displayed. This would be useful 
where, for example, the search was for digit strings rep- 
resenting telephone numbers. 

[0030] Optionally, the signal sample pointers 64 
may be omitted and, where a message comprises a 
voice component, the message operations engine may 
pass the text-based equivalent to a voice synthesizer 
(which may be part of the user interface) to play a voice 
equivalent. 

[0031 ] As will be appreciated by those skilled in the 
art. the automatic dialling may be effected by sending a 
message on network 14 (or other communication path) 
to an automatic dialler or computer telephony interface. 
[0032] If no matches are found, the processor sim- 
ply reports this to the user (S135). If the message oper- 
ations request does not have search parameters, but 
instead identifies a specific message or messages, pro- 
gram control passes from SI 32 to 81 38. 
[0033] As should be apparent from figure 3, the 
envelope 52 may be added as a header to the non-text 
message 54. Thus, the enveloped message 50 com- 
prises a text-based envelope 52 and a non-text (or text- 
based) message 54. Many existing messaging systems, 
such as MICROSOFT EXCHANGE^'", include an 
expandable envelope structure for messages. In such a 
case, the existing envelope structure may be used arKi 
the enveloped message aeator 28 may be unneces- 
sary. Additional fields may then be associated with the 
existing envelope structure. 

[0034] In an alternate and simplified embodiment, 
only the signal sample pointers 64 may be stored in a 
message envelope field on finding one or more signal 
samples falling with a set of preKJefined characteristics 
(arKi not the text-based equivalent). In this case, a user 
could request the system to play/display the signal sam- 
ples pointed to by the sample pointers. For example, a 
set of pre-defined characteristics may identify mes- 
sages from one of several specified company depart- 
ments. The user could then, on request, hear/see these 
departments arxi then decide upon further action based 
on this information. 

[0035] In another embodiment, messages may be 
enveloped and searches for sets of pre-defined charac- 
teristics conducted and ensuing operations urKiertaken 
as aforedescrlbed in conjunction witii figures 1 to 4. 
However, additionally, a user may define a set of pre- 
defined characteristics which, instead of being stored in 
memory for use in conjunction with new messages, is 
searched for immediately in an existing message or 
group of messages specified by the user. Any message 
containing this set of pre-defined characteristics may 
then be further operated upon based on an operation 
enters by the user or recalled from memory. 



8 

[0036] In a further embodiment, it is not necessary 
to envelope new messages. In this embodiment, non- 
text messages are searched for sets of pre-defined 
characteristics, and after finding one or more signal 

5 samples falling within a set of pre-defined characteris- 
tics, the apparatus immediately performs an operation 
on the message (e.g., the message is deleted). This 
operation could be one entered by the user or recalled 
from memory. In another aspect of this emtxxjiment. 

10 after finding one or more signal sanrples falling within a 
set of pre-defined characteristics, the one or more sig- 
nal samples are mapped to a text-based equivalent and 
the apparatus then takes action based on the text- 
based equivalent (e.g.. dial a telephone number) rather 

75 than storing the text-based equivalent and/or pointer 
thereto in an envelope for the message. 

Claims 

20 1, A method for operating on a non-text message, 
comprising: 

searching the message for one or more signal 
samples having pre-defined characteristics by 
25 conparing one or more signal samples with 

said pre-defined characteristics. 

2. The method of claim 1 further comprising: 

30 upon finding one or more signal sannples hav- 

ing said pre-defined characteristics, associat- 
ing a text string with said found signal sanrples. 

3. The method of claim 2 further comprising storing 
35 said text string in an envelope for said message. 

4. The method of claim 3 further comprising storing 
one or more pointers in said envelope in associa- 
tion with said text string, said pointers pointing to 

40 said found signal sanrtples in said message. 

5- The method of any preceding claim further com- 
prising: 

45 upon finding one or more signal samples hav- 

ing said pre-defined characteristics, storing 
one or more pointers pointing to sarcl found sig- 
nal samples in said message. 

so 6. The method of any preceding claim further com- 
prising: 

upon finding one or more signal samples hav- 
ing said pre-defined characteristics, further 
55 operating on said message. 

7. A method for operating on a non-text message, 
comprising the st^ of: 
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searching said message for one or more signal 
samples having pre-defined characteristics; 
upon finding one or more signal samples hav- 
ing said pre-defined characteristics, further 
operating on said message. 

8. The method of claim 6 or claim 7 wherein said fur- 
ther operating on said message comprises playing 
said message. 

9. The method of claim 6 or claim 7 wherein said fur- 
ther operating on said message comprises forward- 
ing said message or a copy of said message. 

10. The method of claim 6 or claim 7 wherein said fur- 
ther operating on said message comprises deleting 
said message. 

1 1 . The method of claim 6 or claim 7 wherein said fur- 
ther operating on said message comprises filing 
said message. 

12. The method of claim 6 or claim 7 wherein said fur- 
ther operating on said message comprises storing 
a part of a message. 

13. The method of claim 6 or claim 7 wherein said one 
or more signal samples having said pre-defined 
characteristics has an associated string of digits, 
and wherein said further operating on said mes- 
sage comprises dialling said string of digits. 

14. A method of operating on non-text messages com- 
prising: 

for each of one or more non-text messages, 

searching each message for one or more 
signal samples falling within one of a plu- 
rality of sets of pre<ief Ined characteristics; 
for each one or more signal samples found 
to fall within one of said sets of pre-defined 
characteristics, storing a text string in an 
envelope for said each message based on 
text-based equivalents associated with 
said one of said set of pre-defined charac- 
teristics. 

15- The method of claim 14 further comprising: 

based on a user input, searching at least one 
message envelope for at least one text string; 
and 

on finding a message envelope containing said 
at least one text string, operating on said mes- 
sage associated with said envelope. 

16. The method of daim 15 wherein said user input 



requests a search for a text string representing at 
least one keyword and wherein said searching step 
comprises searching at least one message enve- 
lope for said at least one keyword and said operat- 
5 ing step coaprises, on finding a text string 
contprising said at least one keyword in an enve- 
lope associated with a given message, operating on 
said given message. 

10 17. The method of claim 15 or claim 16 wherein said 
plurality of messages are stored in a memory and 
said step of operating on said given message com- 
prises one of playing said message from memory 
where said message is a voice message, displaying 

15 said message from memory where said message is 
a facsimile message, forwarding a copy of said 
message, deleting said message from memory, 
and filing said message. 

20 18. The method of claim 15, claim 16 or claim 17 fur- 
ther comprising storing one or more pointers in said 
envelope in association wrth each said text string, 
said pointers pointing to said found signal sannples 
in said message from which said text string was 

25 derived. 

19. The method of claim 18 wherein said given mes- 
sage comprises a voice message and the step of 
operating on sad given message comprises play- 

30 ing said one or more signal samples associated 
with said given text string. 

20. The method of any of claims 15 to 19 wherein said 
user input requests a search for any telephone 

35 number and wherein said step of searching for at 
least one text string having connprises searching for 
any string of digits of a length which could represent 
a telephone number. 

40 21. A method of operating on a message comprising: 

determining if said message is a non-text mes- 
sage; 

where said message is a non-text message 
45 and has pre-defined characteristics, associat- 

ing a text string associated with said pre- 
defined characteristics with said message. 

22- The method of any preceding wherein the non-text 
50 message is one of a voice message and a facsimile 
message. 

23. The method of any preceding daim wherein said 
pre-defined characteristics comprise a computer 
55 network address and vifherein said further operating 
on said message comprises storing said address in 
a bookmark file. 
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24. The method of any preceding daim wherein said 
pre<lefined characteristics comprise a corrputer 
network address and wherein said further operating 
on said message comprises sending said address 
to a browser for accessing a network resource at 
said address. 



prising: 

means for. upon finding one or more signal 
sanrples having said pre-defined characteris- 
5 tics, storing a pointer pointing to said found sig- 

nal samples in said message. 



25. The method of claim 22 wherein said step of oper- 
ating on said voice message comprises dialling 
said at least one text string as a telephone number. 

26. Apparatus for performing an operation on a non- 
text message, comprising: 

a non-text search engine arranged to search 
said message for one or more signal samples 
having pre-defined characteristics by compar- 
ing one or more signal samples with said pre- 
defined characteristics. 

27. Apparatus for operating on a non-text message, 
comprising: 

means for searching said message for one or 
more signal samples having pre-defined char- 
acteristics: 

means for. upon finding one or more signal 
sannples having said pre-defined characteris- 
tics, operating on said message. 

28. Apparatus for operating on non-text messages 
comprising: 

means for storing a plurality of non-text mes- 
sages; 

means for, for each of said plurality of non-test 
messages, 

searching each message for one or more 
signal sanrples having one of a plurality of 
sets of pre<iefined characteristics; 
for each one or more signal samples found 
to have one of said sets of pre-defined 
characteristics, storing a text string in an 
envelope for said each message based on 
text-based equivalents associated with 
said one of said set of pre-defined charac- 
teristics. 
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31. The apparatus of any of claims 26 to 30 further 
comprising: 

means for, upon finding one or more signal 
samples having said pre-defined characteris- 
tics, further operating on said message. 

32. The apparatus of any of claims 26 to 31 further 
comprising: 

a memory storing text-based equivalents in 
assodation with said pre-defined characteris- 
tics for, upon said non-text search engine find- 
ing one or more signal samples having said 
pre-defined characteristics, associating a text 
string with said message. 



25 33. The apparatus of claim 32 further comprising: 



a text-based message operations engine for 
searching text strings associated with said 
message for a given text string and, upon find- 
ing a given text string, further operating on said 
message. 



15 
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45 



34. The apparatus of any of claims 26 to 33 further 
comprising: 

means for, based on a user input, searching 
each said message envelope for a text string 
having certain characteristics; and 
means for, on finding a message envelope con- 
taining a text string having said certain charac- 
teristics, operating on said message 
associated with said envelope. 



29. The apparatus of any of claims 26, 27 or claim 28 so 
further comprising: 

means for, upon firxiing one or more signal 
samples having said pre-defined characteris- 
tics, associating a text string with said found 55 
signal samples. 

30- The apparatus of any of claims 26 to claim 29 com- 
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(54) Methods and apparatus for operating on non-text messages 



(57) Tiie present invention relates to nnethods and 
apparatus for operating on messages, and more partic- 
ularly for operating on non-text messages, such as voice 
and facsimile messages, including, for example, 
searching such messages. 

With known systems, a user with a telephone sys- 
tem and a computer can quickly become inundated with 
infomiation. As such, it is important to be able to sepa- 
rate important messages, or messages which contain 
key information, from routine messages or electronic 
junk mail. With known systems this is difficult. In addi- 
tion, finding key elements of messages can be time con- 
suming and difficult, if not impossible. Known systems 
provide functions forf inding, filtering, filing and re-direct- 



ing textual messages (e.g., e-mail) but do not do so for 
voice or facsimile messages. 

The present invention solves these problems by 
providing a way for each voice message for signal sam- 
ples having one of a plurality of sets of pre-defined char- 
acteristics (such as any seven orten digit number which 
is then assumed to be a telephone number) as diclosed. 
For each signal sample found to have one of the sets of 
pre-defined characteristics, the found signal sample is 
associated with an equivalent text string and this text 
string is stored in an envelope for the message. Based 
on a user input, the messages may be for a given text 
string and on finding a message envelope containing the 
given text string, such message may be operated upon. 
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